Scalable Services for Resource Management in Distributed and Networked Environments

Sharing hardware and software resources among networked workstations has become common practice. Resource management in such systems is complex because of physical distribution of the resources, communication delays and the lack of global state information. This paper describes a scalable load monitoring service and a scalable resource query service developed in the Warp project to provide necessary state information for resource management. Scalability is achieved by reducing network traac. Techniques include exploiting IP multicast for one-to-many communications, using supply-driven and demand-driven approaches for disseminating diierent classes of information, compressing information, and tailoring servers only to publish information when certain conditions are met. GUI tools, statistical analysers, and job scheduling are example clients of the services. Abstract Sharing hardware and software resources among networked workstations has become common practice. Resource management in such systems is complex because of physical distribution of the resources, communication delays and the lack of global state information. This paper describes a scalable load monitoring service and a scalable resource query service developed in the Warp project to provide necessary state information for resource management. Scalability is achieved by reducing network traac. Techniques include exploiting IP multicast for one-to-many communications, using supply-driven and demand-driven approaches for disseminating diierent classes of information, compressing information, and tailoring servers only to publish information when certain conditions are met. GUI tools, statistical analysers, and job scheduling are example clients of the services.